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' Lik^the proverbial iceberg, what can be seen of .Delphi in higher 
education administration is about 10 per cent of the mass/that exists. 
If' you consult' any of .the better knowil bibliographies qn./the Delphi method, 
such^"as- the Rand Corporation listin^J. y6u find one entry on Delphi in 
'education out of a total of 41 listi-n^s. .AJelson's pioneering/article in 

» \. ....... 
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fl..H r.n Rehavi oral - Sci enti s t^Tf^^s nothing beyond Werlner Hersch's book 
Inventing 'Education for the Future w hich- had as its sojirce the same datu 
.Is the Adelsoh article. This paper takes for its focu^ a description and ^ 
comnentary on the extent of Delphi use in -higher education . 

One of the immediate realizations about Delphi is that although devel- 
oped under Air Force sponsorship at Rand, it has had a-wide use in industry. 
Therej-t has had its principal role in technological foi^ecastinq. Another 
major segment of human endeavor to undertake systematic use of the Delphi - 
technique. has be^en the medical field. Th^l^evelopment of Delphi has not 
been limited to the United States. Articles and books on the subject have 
appeared in Great Brita4|i, the Continent and ev^n in Russia.^ 

The other urgent realization about Delphi is that it is not a singular 
ndr unchanging approach to probl em-sol ving.^bout the future. Norman Dalkey, 
one of the principal originators of the.method, speaking at the American 
Statistical Association national meeting at Fort 'Collins, Colorado this past 
1 August tells a story on himself. He relates that in speaking to a group of 
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engineers he was interrupted by "one of them who objecteU, "that doesn 't 
sound anything like the pa^er you wrote six years aqo."^ Dalkey made the 
. point that in a rapid\y changing- field; '^modification in procedures are 
called for."^ In this same addr^s he pointed out that, useful as Delphi- 
may be in forecasting futu.r^ .developments; 'it is beginning to be seen as 
useful in the generation and assessment of goals, and objectives.- 

For. the few readers of this |Daper who have not become acquainted with 

' ' ^ ' 5 ' ' 

' the 'Delphi method, Delphi is characterized by: 

1. anonymity of response 

2. multiple iterations ^ " 

.3.- convergence of the distribution of answers . " 

A. a statisticaT groU^ response (median, inter-quartil'e range) pre- 
serving intact a distribution that ijiay still remain wide. 
The first apparent reference to Delphi or use of Delprtii" in the context of 
'hiqher educatxon was reported in' the Adelson paper cited earlier, the-Hersch 
bqpk- cited abi've'. and in a paper by Olaf Helmer published by Rand in Decem- 
ber 1966.^ ^ - , , 

Since then at .least five major uses of the Delphi method have emergea 

in higher education. These five fields are: 

1. Cost-Effectiveness, Cost/Benefit Analysis 

2. Curriculum and campus planning 

. 3'. Co>lege, Universjty-wide, and State-wide educational qo'^ls and 

objectives. • 
X ^ • 4. ■ Consensus on rating scales, values and other evaluation elements. 
V Generalized educational goals and objectives for the future. 
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A11 the.«rst efforts at using Delphi (Adelson. Hersch..Hel.e.) s.e. to 
' . have been directed at the last itein, generalized educational qoals and 

objectives for the 'future. Today ifnay be the least innortant use. 
- ■ The least developed field in terns of .DelPM "tili.^tion- is the field 

., of cost-effectiveness and cost/benefit analysis. The first public n«ntioh 

Of such use apparently occurred in August 1969 wh^n the Writer presented^, . 
, ■ paper to a Fiscal Managenent seminar" sjjnsored by the U.S. Office. of Educa- 
■ • tionat'Manchest'er,.N.H.' and suggested that in .akin, a cost/benefit^. 

analysts of a proposed change in a liberal arts- col 1 e,e curr^culu., the . 
Delphi technique could be en,ployed to get. a better assessment of the., 

■ .' ■ ■-benefit" side of the propos,d ch^ge.. In -tha't sa^e year, Arnold Riesmn 

published a technical ,.;n,oranZon "Evaluation and Budgetin, Model for a 

■ systen, of Social- Agencies-^ fha't employed a Delphi approach to budget deter- 

, ■■ n,inatiin. The- n»'st complete theoretic discussion of this use ofDelphi 

appears in a Rand publication by E. S. Quade on fost Eff ectiveness: Som e 
. ;, Trends in Analysis .^ Some sense of .the importance of this approach .Sy be 

' ■ communicated' by this excerpt from Quade's Work: 

"in oeneral the value, V, that will be obtained from the . 

•^a.iicr£p^i;.^^^^^^^ 

as in the figure. 



. "A Delphi procedure can then be used* to tfbtain a consensus 
opin4on of the ^an^l regarding two points on this curve: the 
Ja ue qL below which adoption of the project would be pointless, 
and the value qH above which the marginal benefits are so small 
•:o make adoption wasteful. . (One-would expect many estimates. 
|fi<to be zero, indicating total rejection of the project.) 
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There is much that can be done to utilize Delphi' techniques in cost- . 
effectiveness and cost-benefit analyst's. The major deterent is the focus 
of a/^reat manyPPBS advocates on a format for cost, capture, with little 
.if any attention to the effectiveness -or benefit side of the educational 
equation. 

Curriculum and campi>s planning ha^ represented an area'for Delphi use 
t6 a greater extent lhan cost analysis. This area is -difficult to pin- 
point since th^re is a considerable reticence to revealing the use^of Delph 
in thisrealm^ Fof example, although. the earliest known Delphi use ia cur- 
riculum planning 'took place more than two and a half years ago (February 
1969), those pioneers still are reluctant 1;o be identified. This particu-; 
I'^r use of Delphi has been warmly endorsed by Frederick Bolman in speaking 
to the Association- of Cover «ng Boards of Universities and Colleges.in 



October 1970 J ^ The specific reference by Dr. Bolman was divected to an 
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article of this author'that appeared in College and U niversity Business . 

and described, in part, the. use of Delphi in curriculum and' campus planning. 
'An example of the. kind of topics dealt with in that Delphi exercise is 
found in the tabl^e below: ' ' ~- 

' ■ ' ■ ~^ - .... 

Faculty Consens'us 

Disagree Rating Rank IMn! . : 



A 1 Semi-CLars, smalV groups. 

B^, ^. 2 ^ Learning center, variety of methods, car)rels 

3 Counseltng, individual contact,' 

C 4 ■ Individually planned instruction 

VC 7- 5 T Informal enyironnient conducive to learning , 

C 6 Aud'io-Visuals 

C 7 Field work, supervised experiences 

B 8- Computer assisted instrcicti.pn 

B 9 Team teaching 

B \ 10 Laboratories for various disciplipes 

B 11 Lectures, large group presentations - 

A 12 Programmed learning ^ \ 

B 13 Differential staffing, supportive help -for 

teachers 

A 14 Cultural activities 

A 15 Frequent testing 

A 16 Decentralize.d libraries 



This'i^ the actual fomat from' one sgction entitled ."'Teaching Methodolooy" 
and represents a portion of the third round feQb,ack.to participating 
faculty o^at college. The consensus rating is.coded: A - very strong - 
consensus, B -."strong consensus. C - niodera.te consensus. D - little consensus. 
The space, "faculty disagreement" was for use by any recipient >n expressi^ng ^ 
disagreement. The instructions called for, "in'dicating disagreement as to any 
:.item 4nd.wri ting in the space provided below the listing, the reasons f^r dis-. 
agreement. (i,e.. whet-her the i.'tem shoi^d be ranked higher or lower, and why). 
At the conclusion of 'that Delphi exercise on curriculum planning,' the change • 
proposed by group consensus was successfully 'adopted by a vote of the full 
faculty of this 'pioneering college. . • 

At the present time, a pri)fessional 'college of a major midwestem univer- 
sity .is about to embark on a Delphi exercise ?eek>ng a consensus about changes 
" needed in their curriculum.' The wd^r has 6^ privil-eged to be invited to- 
advise and review this' undertaking, but again, there is a prohibition agaitist 
ideatifying the undertaking. ' Perhaps the^e schools are observing Dr. Bolman's 

111 3 

' advice to "change more and talk less.about.it." • ■ ^ . . 

Probably th6 greateV visibility of Delphi use for College, University-^ 
wide> State-wide educational goals and objectives planning is the conse- 
quence of at least two AERA forums where, reports of this type of activity ,■ 
have been encouraged^ as' well as the fact that /imost without^exception these • 
Delphi exer-cises have engaged .the attention of those outside the immediate 
institution involved.' Thus, the University, of Virginia involved more than 400 

. respondents in their Delphi exercise. These represented 89 rdated to the 
hculty 0. student body of the School of Education, 58 other leadership 
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positions in the Univer'sitJ' of Virginia, 41 ^off campus educators in Virginia, * 

48 influential Virginia "indiviauals. who were not necessarily professional 

educators, 73' influential political individuals, 82 influential newspaper, 

business and labor individuals plus 30 teacher educators of national reputa- 

tionJ^ They asked for five or six word answers to complete the following 

sentence, "by citijig no fewer than one nor more 'than five 'targets. "J ^ 

"In the npxt decade, the School of Education of the University 
of Virginia should concentrated ts energies and resources op: 



increasing 
solving 



developing_ 
Preparing_ 



( 



) 



This resulted in (almost 300) responses involving 750 answers which were con- 
densed by the investigating group into 61= generic statements. The following 
excerpt from the second round questionnaire includes one bogus item. No. 44, 

that was intentionally inserted. , . , . , 

f 



High 



Low 



( 1 2 3-4 5 ) 35. Preparing teachers- and administrators at the graduate 

level, without repairing prior- experience. ^ 

( 1 2 3 4 5 ) 3€. Reconciling emerging conflict/in the teaching 'pro- 

' fession between an emphasis upon human values and an 
emphasis upon knowledge and technology. I 

( 1 2 3 4 5 ) 37. Preparing plans which schools could use for goal 

definition. . " ■ 

( I 2 3 4 5 ) 38. Explore the possibility of twelve-njonth school term. 
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f 2 3 4 s""") 39- increasing the qualitative status of the teacher 

in contemporary society. 

1^'2 3 4 5 ) 40- Eliminating competition ainong institutions of 

higher learning in Virginia. 



2 3 



2 3 



4 
4 



5 
5 



1 2 3 4 5 



) 41. Preparing interdisciplinary courses for high school 
adoption. • » 

) 42 Providing the kind of education needed to solve the 
■ problems of contemporary society, such as urban and, 
' communication problems. 

Developing programs that will increase the capabiU 
ities of graduates of the School of Education to 
.produce and utilize research. 



2 3 



). 43.^ 
) 44. 



4 5 ) 44. Emphasizing thrProdHction of doctoral gradu^^^^^^ 

who can improve the programs in Schools of Medicine, 
Law, Nursing, and Engineering. . 

1 ? 3 4 5 ) 45. Developing criteria, procedures, and tests for mea- 
' ^-""^ ^ suring without bia^ such factors as pre-school ,- 

skills, teacher effectiveness, educational programs, 
- ' and in-tellectual aptitude. 



2 

'2 



3 4 

3 '4 



5 
5 



) 45. 

) 47, 



1 .2 3 4 5 °) 48, 



Increasing intellectual cself-respect of the grad- 
uates of th6 School of Education. 

Preparing teachers and administrators to utilize 
effectively modern technology such as educational 
television and qompgter assisted instruction. 

Increasing professionalism in education. / 



12 3 4 5) 49. Providing leadership and assistance to school divis- 
' ^ ^ sions in developinq a strong medical department, 

' ^ •^inclu^ing school nurses. 



Developing greater respect for traditional American 
loyalties. 



1 2 3 4 5 ) 50 
1 2 3 4 5;) 51. Attracting more men into elementary education 



{'l .2 HI 4 5 )■ .42. 
Reason : 
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The basically negative reaction to .this phony statement is evident in the 
following excerpt from the third round instrument: 

High ^ Low 

Qvour Response □ Consensus 

M 2 3 1^ 5 ) 37. Preparing plans which schools could use for goal 

Reason: ~ definition. 

'((g 2 3 4 5 ) 38. Explore the possibility, of twelve-month school term-. 
Reason: 

(1 2 1 III 5 ) 39. Increasing the' qualitative status of the teacher in , 

Reason: contemporary society. 

( in 2 3 4 5 ) 40. Eliminating competi'tion among institutions of higher 

Rea.on: * learning in Virginia. 

2 3 ll! 5 ) 41. ?reparing interdisciplinary courses for high school 

Reason: M adoption. , 

n Providing theWid of education needed to solye the 
problems of contemporary society, such as 'urban and ^ 
communication problems. ^ 

> • 

^'^ 7 ^ l4l 5 ) 43 ^ Developing programs that will increase the capabil- 
LLon- ^ ities Sf graduates of the School of EducaWon to 

" • produce and utilize research. , f 

I ^ 0 ^ m «^ \ 44 Emohasizinq the production of doctoral graduates 
LLon-- ^ ^ ^ So «i improve the programs in Schools of Medicine. 

^ Law, Nursing, and Engineering. 

* 

M 2 (31 4 5 ) 45. Developing cri teri a , procedures , and tests for tnea- 
LLon- ^ " suring without bias such factors as pre-sc*ool 

skil'ls, teacher effectiveness, educational programs, 
and intellectual aptitude. 

M 2 3 l4l 5 ) 46. Increasing intellectual self-respect of the graduates 
^gason': of the School of Education. 

{ ^ ? Ill 4i 5 ) 47. Preparing teachers and administrators to utilize 
LLon- effectively modern technology such a^ educational ^ 

' television and computer assisted instruction. . 

(1 2 in 4 5 ) 48. Increasing professionalism in education. 
Reason: 



r High 



( (T| 2 3 4 5 ) 49, 
Reason: ' 



I 1 2 3'. El 5 ) 
Reason: 

(1 HI 3 4 5 ) 51. 
Reason: 

(.1 2 "3 El -5 ) - 
Reason: 
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Providing leadership and assistance to school 
divisions in developing a stron^'fnfedical depart- 
ment, including school nurses, 

Developing greater .respect for traditional American 
loyalties'. ^ 

Attracting more men into' elementary education. 

Developing qua-lity courses for adoption and 
. adaptation by elementary and secondary schools such 
as interdisciplinary courses. 



(12 3 0 5)^^- Developing a model undergraduate program. 

Reason : , ^ 

M ? m 4 5 ) 54. DevelopiVig experimental programs designed to meet 

Reason: ^ ' the educational- needs of minority groups. 

(12 3 m 5 ) 55. Solving problems related to the* increasing role'of 
Reason: ' Federal government in education. - ■ 

Another instance of the use of Delphi in state^wide planni.nq is reported by 
James Jacobson of Utah State University who repprted the use of a Delphi 
exercise involving one state committee of an Eight-State Project on "l^esion- 
ing Education for ■ the 'Future. " His discussion^^ of the problems encountered 
is as candid a disclosure of some of the realities as I have seen. This 1970 
session of the American Educational Research Association was the forum where 
Bean Cyphert's and Dr. Ganfs work was fiVst discussed and, was the occasion: 
for still another example of ' a Delphi exercise applied to educational planning, 
.'ihis was the report by Donald Anderson of Ohio State University who discussed 
the use of a Delphi exercis^ undertaken with university help with an inter- 
mediate school district in Ohio.^^ An example of a page from the second 
round questionnaire is reproduced following: 
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1 ■ ■ 

11 



Event ■ 


Est. 
Date ■ 


V 


alue 
to ■ 
You 


. ^ 


Consolidation will reduce the 
number of school districts to 
approximately 100. 

r 










Compulsory school attendanqe 
will be relaxed in most .sub- 
urban schools, and students 
wil/1 attend "the" school only 
iwhen classroom orolabor^tory 
'activities are needed by the 
-Student. 








1 


dne conseduence i)f increased ■ 
individualization is that 
'students kill enter public 
school, at ages -ranging from 
3 to 7 a<id leave at ages 
* ranging from 15 to 20 
depending on readiness to 
pursue their chosen goals. 


) 

0 

o 

(' 


/ c 

4 






— . « ■ 

Formal policy making and 
daily administrative deci- 
sions will be directly 
influenced by involved 
■staff, students, teachers, 
■parents, and community 
representatives in 90 per 
cent of urban and suburban 
schools.. 




\ 




\ 


* Drugs wiP .be used to 
^. stimulate and increase 
learning. 
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.These illustrations make clear the diversitV of topic and apprjjaeh 

lis is^us^uli In 



taken in these different Delphi exercises'. Hopeful.ly thfs is*usfful/ 
any:cas«, the conclusix)n -that seems V^arranted is that a wide.Tanqe o!f 
poTsibie goals and objectives, evaluated by quite different publics 



:an be 

the object of.a Delphi exer.cise. This^^be of considerable importance 
to the' f^re. course of higher education, and to education qenerallj. 

' One of theS^T^jects funded-under granjt from the U.S. Office oWEduca- , 
tion this year fSVeffort by the Coordinating Board of Advanced jducation 
- m Accreditation in\w Hampshire to li'ndertake a Delphi embracing! repre- 
sentation from -members of the following bodies: 

A. CDordinatIng Board \ , . • ^ 



F. 
6. 
H. 
■ I. 
J. 



B. -Fatilities Conmission\ 

"C. State Legislative Finance Conmittee * ^ 
Pt - State Legislative Education- Coimiittee 
k. State Board of Education' 

Staite Department of Vgcational-Technical Education 
Trustees .of- all .higher educational institutions 
Key administrators of all .higher educational institutions 
Student leaders from all higher educational ihstitutioTjs 
Appropriate representatives from bus iijess and indus-try. 



The purpose of the undertaking is reported to be • . ' / 

"to successfully respond to the charge given by the U.S. Office 
^ of Education n its BHE-^DAF memo dated December 29. 1970. on 

^!.!^W?"n of' Snstruction Needs : . . development^by each 
ct^tr$ a ?onq-ranqe plan for the d etenni nation of construction 
^ t5v2lr Jfinstitutiofts of higher education . -. . in -iuffWient . 
Seta 1 S ie mian?igfu to fhe cLission and .the Institutions 
. ' Th^ylhS Ee considered dynamic - subject to penodrc • , 

mi^w and ajnendment - and should include all elements the Com-^^ 
: mission considers necessary to develop construction need^ . . . 

As far as can be learned, this will represent the first time that th^e 
Delphi technique ts been undertaken in so direct a fashion to mesh with the 
state planning activities encouraged by the U.S. Office of .Education. . 

One of the most obvious uses of the Delphi technique in the educational 
scene would seem to>e its use^n finding consensus as to values, or.evalua- 
tions. An example would be the kind of rating scale frequently encountered 
in rating teachers. ' There are only two examples of this kind of use of 
Delphi that the present research has turned up. The earliest recorded use 
of Delphi as an evalufeion aid involves a paper prepared by Arnold Reisman . 
of CaVwestern Reserve University for delivery at -the Management qivision 
of the American society of Mechanical Engineers at the Winter Annual meettng 
in New YoVk in iges.""^ Or. Reisman's approach is reproduced in part follow- 
ing; . He considered five factors: journal afticles. books, public.service. 
conriittee service on-university eonnittees and service in professional soc- 
ieties. These iJ^re recorded for faculty members as in th,e table on the . 
20| 

. following page: / . 
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<^ Then Reisman'-- suggested th.t one way to reach a consensus on the^^weight each 
type of entry should have, would be to employ a Delphi technique. One. such 
' point Vjilue outcome (Point System 1) is given below: . • . 

POINT SYSTEM 



1^ 

V 



I. . PUBLICATIONS 

A. JOURNAL ARTICLES 



LA 


10* 


L-B 


8 


LC 


6 


LO 


4 


TA 


7 


TB 


«- 


TC 


3 


TO 


1 


P 


• X4 ' 


F 


X3 


S 


XI 



♦Point System 1 

. II. PUBLIC SEl^VICE 

* . 

L * 4 
R 6 
N 8 
I 10 

A x4 

I B ^(3' 

' , C X2 • 

D XI 



D 
S 
U 
6 



BOOKS 




LA 


100 


LB 


80 


LC 


60 


• LD, 


40 




90 


TB 


70 


TC 


50 


ID 


40 


P 


X5 


F 


X4 


S 


X2 



III. COMMITTEE PARTICIPATION / 
A. UNIVERSITY • y COMMITTEES 



6 
8 
10 
6 

X2 
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B PROFESSIONAL 

T 

I 
N 
R 
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SOCIETY 

10 

5 

X4 
X3 
XI 



.22 



His sumnary of the r'c^ttngs achieved is:' 

POINT RATING* 



CRITERldN 




Faculty Member 




. : — 




1- 


■ 2 


3 


4 


5 




Record of 
Publications 














Journal /Vrticles 


0 


69 


68 


198 


290 




Books 


710 


0 


■ 0 


0 


400 

♦ * 




» 

Committee Part. 




> 








f 


Universfty 


122 


80 


26 


52. 


• 318t 
540 




Professional 
. Society 


180 


0 


70 


30 




Pu^li^ Service 


80 


28 


96 


240 


0 , 




1,092 


177 


260 


520 


.1,548 


T , 




1,172 


205 


356 


760 


1,54a 





.t.Kftn?;"; Se;t°:/Sl!|e::&X2 ^oes not Cange t.e tyt,, 
'ranking. ' ^ 

The other approach to using Delphi as a method of Obtaining consensus 
,about the value of characteristics of teachers in a col-lege is found in the^ 
work Of Samuel W. Cochran and his associates23 at East Texas State University 
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Dr. Cochran is a co-author with Norman Dalkey and others of the Rand staff ^ 
of several reports that Rand has published. His approach to using the . 

♦ 

DelpM technique in the rating problem- was to take the list of-teacffer 

charlcteristics used-at East Texas State and ask thafeach of four panels 

» / 24 

evaluate them. "'The. list of' teacher characteristics read'.as follows: ■ 
TEACHER 'characteristics SUBMIHED TO "RESPONDENTS FOR EVALUATION 



1 -Teacher should have a thorough knowledge of the course material . 

2** {laches's \^se of the textbook should be'appropriate for the course. 

3 - Ser should relate the subject matter of course to course objectives 

4! Tiache? shSUld select a -textbook that is appropriate,.for th| -.course, 

5 Teacher should possess pleasing- voice qualities. > 
6* Teacher shouKI show, interest in the subject matter. , 

I. Teacher should insure that objectives of the course are easily under- 

8. ' TeacheJ^ should possess a good attitude toward all students. . ■ 

9. Teacher -^should mke himself available to students to discuss academic 
or personal problems. • ^■^\, 

10 Teacher should organize the content of the course logically.* 

II . 'Teacher's use of Reference materials should be appropriate for the . 

12. Teaser's assignments should be appropriate to course objectives. 

13^ Teacher should speak in. an intelligible and understandable manner. 
14* Teacher should make 'the course material interesting. 

15. Teacher should dress in an appropriate manner. 

16. Teacher should exhibit satisfactory .mannerisms before the class. 

17. Teacher's evaluative techniques should be appropriate to the course 

18. Teicher'shoyld r'elate the material in the.couri^ to other fields^. 

19. * Teacher should be fair in grading students. 



18. 
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His'tnajor findings ^re represented by 'the two tables below. 
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TABLE A 



Correlations between Rank Order of Teacher Characteristics of Rounds 1 and 

0 Z Based on .Importance Ratyigs 



T 


Groups 

V 


1 


1 


2 




4 


Correlations between 
value judgments on 
^Rounds 1 and 2 ' 


.98 


.98 


.9k ' 


.99 



NOTE- In Round 2, each respondent was provided with h^s i^esponses to 

Round 1 and a statistical sumnary of the importance ratings of the - 
other members of his group. He was given an opportunity to revise hs 
imSoKance ratings to each of the 19 characteristics. The probability 
i7?he Sbove correlations occurring>by chance is less than one time in 
one hundred. , ; ' 



TABLE B 

Correlations between Ranks Obtained by Assigning Relativfe and Absolute 

Values to Teacher Characteristics 



Correlations 



Groups 1 & 2 
(Facirlty) 




Groups 3 & 4 
(Students) 



NOTE: Respondents in Groups J ^nd 3 assigned relative values- (di^^^^^^ 

1.000 points) and subjects in Groups 2 and 4 assigned absolute values 
n 7 craiP^ to each of the 19 teacher characteristics. The character- 
ises were pUced in rank irder a cording to their assigneid importance 
n Sccessful college teaching and rank order cp^^el^J^J^^^^.^X 
iuted between the rankings based on Round 2. The P/obabi ity of the 
above correlations occurring by chance is less than one time in one 
hundred. 
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I.t>^as Dr. Cochran's.. conclusion that the Delphi technique performed very 
will at determining consensus on these kinds of value ratings. There is 
a significant place for this kind of use of the Delphi technique. 
Throughout academic life there are issues that call for the explication 
of values and .the expression of evaluation by faculty groups. R seems 
likely that the Delphi technique should have a wide use. 

. It is also possible to use Delphi 'as a learning device, or as a device 
to develop capacity for 'futures' thinking. - As with any new field there - 
have been some developments whose authors have chosen to give them new. ^ 
although related^Cames. Thus, we find' "Focus Delphi. "^^ and "Onejvent - 
Delphi. ''27 and Delphi games. tach of, these developments has had for its 
focus a special need perceived as requiring an'adaptation of the original 
Delphi ap^oach. it is'this writer's conclusion that the Delphi rubric is 
.already sufficiently expanded as a technique in form and purpose that in- 
dividualization of adaptations by giving them special names add little to 
our sum total of problenj-sol ving capability. 

Important to the pur'pose of this paper must be consideration of the 
c^-ticism that has been raj^sed about the Delphi approach. Th^s principally 
inv^olves the work of Weaver. Waldron and;Welty. Each of these three have 
made challenges of varying significances tQ the use of Delphi in higher 
education. The least substantial of these would appear to be Dr. Welty's 
concern^^ with the potential consequences of the insertion of bogus items 
as in the Cyphert-Gant study reported earlier.' It seems obvious^^at any 
research or probl em-sol \ring undertaking can not be made proof against 
scoundrels. All .that the insertion of item 44 in the Univer^sity of 
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Virginia Delphi exercise represenl^s is a healthy further reminder to aVl 
that,. by intention, as well as by misadventure, spurious elements can get. 
into any research endeavor. The character of the sponsors, the principal . 
investigator and the ever present possibility of replication Ve^ the only 
safeguards that can exist.. Dr. Welty seems "overly concerned With th'e se- 
lection of experts as his second critical view. The use of the expert as 
part of the Delphi exercise response group is at the discretion 

. of each principal investigator and, will , necessarily, be defined by him. ' 
At least in matters pertaining to e'ducatibn, let alone higher education, 
it would be h.atfd not to find 'experts' on every hand. • 

James S. Waldron's wbrk and th.at of wSimothy Weaver is related, 
since each devoted their doctoral dissertations to^a consideration of fore- 
casting future events. Waldron's dissertation specifically concerned itself 
with the Delphi process while Weaver considered^ther approaches as well as 
the'" Delphi approach. The concern expressed by Waldron^O i«n terms of the 
problem of low integratively complex persons versus high integratively com- 
p-lex persons does not seem to this writer to have been linked up to actual 
Delphi operations. The probable characteristics that can" be expected to be 
encountered in prospective Delphi participants has not been shown to be LIC 
or HIC as a general rule. Waldron's view' on the problem of differential 
time delay^l appears more germane to the use ofoDelphi in higher education. 

,. There would seem to be a sol ution-in-^he-pr^vAcative work of Dr. Murray 
Turoff and hisVperimentation with the Delphi Conference, a teletype 
terminal computer-linked ".conference ca.lT\apability to Delphi. ^2 This is 
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particulaVly true in many higher education situations where .computer 
terminals are readily available. 

W. T. Weaver present^^^ more philosophic view of future cognition. A 
sampling of his thought is reflected in the follo^^ing excerpt:33 • ; * 

Th'e intention was to 'assure that through questionnaires', 
changes in estimate.s would .reflect rational judgment, and, 
therefore, not be subject to social psycholoqical factors. 
Empirical evidence tends to shoW the naivete' of such an 
' assumption. Three independently conducted studies suggest 
that within the p»*phi procedure individuals who swing in 
from wide ranges to more, narrow ranges do so less on the . 
' basis of .rational argument, examination of evidence, or 

review of assumptions than bec'aus^e decision-making strategies . i 
of certain persons are subject to change as the task is per- j 
, . ceived to be less ambiguous, and on account of certain per- / 
so nality .factors such as fundamental needs and integrative - 
complexity. ' , ° ' ' 

.However, despite Or. Weaver's reservations about the use of, Delphi, he 

34 

concludes his article in the Phi Delta.Kappan with the following: 

♦ • . 

although Delphi was originally intended as a forecast- 
ing tool,its more promising educational application seems to 
be in the following areas: (a) a method for studying the^ 
process of thinking about the future, (b) a pedagogical tool 
or teaching tool which forces people to think about the 
future in a more complex yfay than they ordinarily wof^d. and 
(c) a planning tool which may aid in probing priorities held 
by members and constituencies of an organization.^ ^ i 

It may be asked, what are the costs of Delphi, in time and money? 
* It is difficult to make a direct comparison on either count, because you 
. have to inquire, whdt'are tf e costs, compared to what? Any in^nsive 
method of consensus formation wi presumably cost more than.a/fe*|e^casual 
undertaking, if only because the apparatus for the assembling of (jlpim 
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has to have some cost that is greater than the inore casual coimiittee meeting 
or other method for determining what may constitute a meeting of minds. The 
time dimension may also be greater .for Delphi than its more casual alterna-^ 

5 Si nee' in at least some face-to-face committee situations there will 
dominant person who railroads the decision through, this can not help ' 
le more expeditious than any other method that seeks iterations of 
^ opinion, two, three and four or more times. Thus, it seems clear that the 
adoption V Delphi .as a method .to reach a consensus on any aspect of educa- 
tional problem-solving can not depend oh its being less costly in dollars 
nor in time. Neverthelesss, an. examination of the data presented it seejns 
. a tenable conclusion that higher education can benefit from employing Delphi 
as a method for planning. Given the extent of education's n^ed for more 
and better planning, this is as high a>priority mission as any^tecH^ique j" 
could wish for! The present concern for methods of seeking out consensus, 
' the techniques for discovering futures, is a healthy development that bodes 
well for higher education and for problem-solving in general. Nor is the 
Delphi the only product of this quest. We may yet find that methdds that . 
' have been named as variously as Oan, Judge, Prof, Decision Dispjay f|anels. • 
\(^apping, future histories, scenarios and cross-impact matrices will be 
helpful in solving cost/benefit or curriculum planning or college objectives 
or teacher rating problems in the coming decade. 
I . . 
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